Substitutional reality:using the physical environment to design virtual reality experiences

Experiencing Virtual Reality in domestic and other uncontrolled settings is challenging due to the presence of physical objects and furniture that are not usually defined in the Virtual Environment. To address this challenge, we explore the concept of Substitutional Reality in the context of Virtual Reality: a class of Virtual Environments where every physical object surrounding a user is paired, with some degree of discrepancy, to a virtual counterpart. We present a model of potential substitutions and validate it in two user studies. In the first study we investigated factors that affect participants' suspension of disbelief and ease of use. We systematically altered the virtual representation of a physical object and recorded responses from 20 participants. The second study investigated users' levels of engagement as the physical proxy for a virtual object varied. From the results, we derive a set of guidelines for the design of future Substitutional Reality experiences

Public HMDs: Modeling and Understanding User Behavior Around Public Head-Mounted Displays

Head-Mounted Displays (HMDs) are becoming ubiquitous; we are starting to see them deployed in public for different purposes. Museums, car companies and travel agencies use HMDs to promote their products. As a result, situations arise where users use them in public without experts supervision. This leads to challenges and opportunities, many of which are experienced in public display installations. For example, similar to public displays, public HMDs struggle to attract the passer-by's attention, but benefit from the honeypot effect that draws attention to them. Also passersby might be hesitant to wear a public HMD, due to the fear that its owner might not approve, or due to the perceived need for a prior permission. In this work, we discuss how public HMDs can benefit from research in public displays. In particular, based on the results of an in-the-wild deployment of a public HMD, we propose an adaptation of the audience funnel flow model of public display users to fit the context of public HMD usage. We discuss how public HMDs bring in challenges and opportunities, and create novel research directions that are relevant to both researchers in HMDs and researchers in public displays

A miniaturized display network for situated glyphs

We demonstrate a novel approach for building situated information systems using wirelessly connected miniaturized displays. These displays are spatially distributed in a physical work environment and present situated glyphs - human-readable abstract graphical signs - to provide activity centric notification and feedback. The demo will showcase how such miniaturized display networks can be used in dynamic workplaces, e.g., a hospital to support complex activities

Three-point interaction:combining bi-manual direct touch with gaze

The benefits of two-point interaction for tasks that require users to simultaneously manipulate multiple entities or dimensions are widely known. Two-point interaction has become common, e.g., when zooming or pinching using two fingers on a smartphone. We propose a novel interaction technique that implements three-point interaction by augmenting two-finger direct touch with gaze as a third input channel. We evaluate two key characteristics of our technique in two multi-participant user studies. In the first, we used the technique for object selection. In the second, we evaluate it in a 3D matching task that requires simultaneous continuous input from fingers and the eyes. Our results show that in both cases participants learned to interact with three input channels without cognitive or mental overload. Participants' performance tended towards fast selection times in the first study and exhibited parallel interaction in the second. These results are promising and show that there is scope for additional input channels beyond two-point interaction

Feet movement in desktop 3D interaction

In this paper we present an exploratory work on the use of foot movements to support fundamental 3D interaction tasks. Depth cameras such as the Microsoft Kinect are now able to track users' motion unobtrusively, making it possible to draw on the spatial context of gestures and movements to control 3D UIs. Whereas multitouch and mid-air hand gestures have been explored extensively for this purpose, little work has looked at how the same can be accomplished with the feet. We describe the interaction space of foot movements in a seated position and propose applications for such techniques in three-dimensional navigation, selection, manipulation and system control tasks in a 3D modelling context. We explore these applications in a user study and discuss the advantages and disadvantages of this modality for 3D UIs

Exploring Archaeological Parks by Playing Games on Mobile Devices

Explore! is an m-learning system that combining e-learning and mobile computing allows middle school students to interact with learning materials in different ways while playing a game in an archaeological park. Design is based on user-centred and participatory approaches. The evaluation of Explore! through systematic field studies has shown that it is able to transform the visit to archaeological parks into a more complete and culturally rich experience. Thanks to the generality of the software infrastructure, games to be played in different parks can be easily created; to this aim, an Authoring Tool to be used by history experts and/or teachers has been developed

Assessing Social Text Placement in Mixed Reality TV

TV experiences are often social, be it at-a-distance (through text) or in-person (through speech). Mixed Reality (MR) headsets offer new opportunities to enhance social communication during TV viewing by placing social artifacts (e.g. text) anywhere the viewer wishes, rather than being constrained to a smartphone or TV display. In this paper, we use VR as a test-bed to evaluate different text locations for MR TV specifically. We introduce the concepts of wall messages, below-screen messages, and egocentric messages in addition to state-of-the-art on-screen messages (i.e., subtitles) and controller messages (i.e., reading text messages on the mobile device) to convey messages to users during TV viewing experiences. Our results suggest that a) future MR systems that aim to improve viewers’ experience need to consider the integration of a communication channel that does not interfere with viewers’ primary task, that is watching TV, and b) independent of the location of text messages, users prefer to be in full control of them, especially when reading and responding to them. Our findings pave the way for further investigations towards social at-a-distance communication in Mixed Reality

The VR Motion Tracker:visualising movement of non-participants in desktop virtual reality experiences

In this paper we present the VR Motion Tracker: a widget that informs users of VR applications of the movements of nonparticipants. The design of the widget is inspired by the the motion tracker used in the Alien film franchise. It uses a Kinect to detect other people in the room, besides the user of the VR application. Our system maps this information to a sphere placed within a triangular plane representing the Kinect's field of view. When these non-participants move, the position of the sphere is updated, allowing the user to be aware of nearby movements. We performed a preliminary study where we presented nine participants with our widget design. We found that they considered the widget to be useful and not distracting. We discuss which features they found interesting, and other information and features they considered useful for a future version of this widget.status: publishe